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Projector-type image display system, projector, information storage medium and image 




projection method 





(57) To provide a projection-type image display sys- 
tem, a projector an information storage medium., and 
an image projection method that enable simple chang- 
ing of a projection position, a liquid-crystal projector is 
provided with: a sensor 60 which senses a projection 
target area and outputs sensing information; an edge 
detection section 146 which outputs detection informa- 
tion, based on the sensing information; a projectable ar- 
ea determination section 144 which determines a pro- 
jectable area which has no obstructions within the pro- 



jection target area, based on the detection information; 
a projection area selection section 142 which selects a 
projection area within the projectable area, based on a 
user selection or a predetermined reference; a projec- 
tion-area/pixel-area associating section 130 and a lens 
adjustment section 1 60 which performs predetermined 
adjustments in such a manner that an image is dis- 
played on the projection area; and an image projection 
section 190 which projects an image towards the pro- 
jection area, based on the input image information. 
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Description 

BACKGROUND OF THE INVENTION 

[0001] The present invention relates to a projection- 
type image display system, a projector, an information 
storage medium, and an image projection method that 
enable changes in projection position. 
[0002] Projection-type image display systems such 
as liquid-crystal projectors are used in various situations 
such as classrooms, cinemas, meeting rooms, exhibi- 
tion hails, and domestic living rooms. 
[0003] When a liquid-crystal projector or the like is 
used to project an image, any obstruction between the 
image projection section and the projection surface will 
generate a shadow caused by the projection light hitting 
the obstruction, and the obstruction itself could block the 
field of view, making the image difficult to see. 
[0004] In a domestic living room, for example, the liq- 
uid-crystal projector would not only be used by the user, 
but also by the family of that user. For that reason, even 
if the user has reserved a large area of a wall surface 
as a projection area, other members of the family could 
dispose furniture or decorative plants on that wall sur- 
face, or the user could cover part of the projection area 
with furniture without thinking. 

[0005] Similarly, when product introduction images or 
advertising images are projected in an exhibition hall or 
the like, people could enter an area within the projection 
area unexpectedly, making the images difficult to see. 
[0006] In such a case, it is usual for the user to move 
the liquid-crystal projector or change the projection di- 
rection of the liquid-crystal projector, to project an image 
that avoids obstructions, but moving the liquid-crystal 
projector or changing the projection direction thereof is 
labor-intensive, and it also necessitates re-calibration. 
[0007] When a liquid-crystal projector is employed to 
project an image, the user would also want to project an 
image on a projection area selected by the user on the 
basis of the circumstances during the projection. 
[0008] If the living room and kitchen are integrated in- 
to the same room, the user would usually project images 
on a wall surface of the living room, but might also want 
to project an image onto a wall surface in the kitchen 
when cooking. 

[0009] During a presentation, a right-handed present- 
er would find it easier to use an indicator rod with an 
image that is displayed on the right side, as seen from 
the audience, whereas a left-handed presenter would 
find it easier to use an indicator rod with an image dis- 
played on the left side. 

[0010] In such a case, it would be preferable to 
change the projection position of the image in order to 
give a more effective presentation, but it would be time- 
consuming for the presenter to adjust the projection po- 
sition of the projector manually and perform recalibra- 
tion. 



BRIEF SUMMARY OF THE INVENTION 

[0011] The present invention was devised in the light 
of the above-described problem and may provide a pro- 
5 jection-type image display system, a projector, an infor- 
mation storage medium, and an image projection meth- 
od that make it possible to change the projection posi- 
tion in a simpler manner. 

[0012] To solve the above-described problem, a pro- 
10 jection-type image display system and projector in ac- 
cordance with an aspect of the present invention com- 
prises: 

sensing means for sensing a projection target area 

'5 and outputting sensing information; 

detection means for performing edge detection or 
color-distribution detection based on the sensing in- 
formation and outputting detection information 
which indicates edge in a sensed image or color dis- 

20 tribution in a sensed image; 

projectable area determination means for determin- 
ing a projectable area which has no obstructions 
within the projection target area, based on the de- 
tection information; 

25 projection area selection means for selecting a pro- 
jection area within the projectable area, based on a 
user selection or a predetermined reference; 
adjustment means for adjusting at least one of input 
image information and image projection means, in 

30 such a manner that an image is displayed on the 
projection area; and 

image projection means for projecting an image to- 
wards the projection area, based on the input image 
information. 

35 

[0013] An information storage medium in accordance 
with a still further aspect of the present invention stores 
a computer-readable program, the information storage 
medium causing a computer to function as: 

40 

sensing means for sensing a projection target area 
and outputting sensing information; 
detection means for performing edge detection or 
color-distribution detection based on the sensing in- 
45 formation and outputting detection information 
which indicates edge in a sensed image or color dis- 
tribution in a sensed image; 

projectable area determination means for determin- 
ing a projectable area which has no obstructions 
50 within the projection target area, based on the de- 
tection information; 

projection area selection means for selecting a pro- 
jection area within the projectable area, based on a 
user selection or a predetermined reference: 
55 adjustment means for adjusting at least one of input 

image information and image projection means, in 
such a manner that an image is displayed on the 
projection area; and 
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image projection means for projecting an image to- 
wards the projection area, based on the input image 
information. 

[0014] An image projection method in accordance 
with an even further aspect of the present invention 
comprises: 

sensing a projection target area and outputting 
sensing information; 

performing edge detection or color-distribution de- 
tection based on the sensing information and out- 
putting detection information which indicates edge 
in a sensed image or color distribution in a sensed 
image; 

determining a projectable area which has no ob- 
structions within the projection target area, based 
on the detection information; 

selecting a projection area within the projectable ar- 
ea, based on a user selection or a predetermined 
reference; 

adjusting at least one of input image information 
and image projection means, in such a manner that 
an image is displayed on the projection area; and 
projecting an image towards the projection area, 
based on the input image information. 

[0015] Since the present invention makes it possible 
for the projection-type image display system or the like 
to automatically determine a projectable area that does 
not contain obstructions (such as desks or members of 
the audience), it enables the user to change the projec- 
tion position easily. 

[001 6] With the projection-type image display system, 
the projector, and the information storage medium, the 
image projection means may have projection size ad- 
justment means which adjusts a projection size, and 

the adjustment means may output projection size 
control information to the image projection means so 
that an image is projected onto the projection area, the 
projection size control information being used for con- 
trolling the projection size adjustment means. 
[0017] In this projection-type image display system, 
projector and information storage medium, the projec- 
tion size adjustment means may adjust a lens zoom ratio 
for projecting an image in such a manner that a projec- 
tion range for the projected image becomes a minimum 
size including the projection area selected by the pro- 
jection area selection means. 

[0018] This image projection method may further 
comprise controlling the image projection means to ad- 
just a projection size so that an image is projected on 
the projection area. 

[0019] Since this makes it possible for a projection- 
type image display system or the like to adjust the pro- 
jection size automatically, the user can change the pro- 
jection position in a simpler manner, without having to 
adjust the projection size. 



[0020] In particular, it is possible for an projection -type 
image display system or the like to increase the bright- 
ness value of the image and display a brighter image 
than in a case that an image is displayed in the maxi- 
5 mum projection size, by adjusting the zoom ratio of a 
projection lens in such a manner that the projection area 
for the projected image becomes a minimum size includ- 
ing the selected area. 

[0021] In this projection-type image display system, 
10 the projector, and the information storage medium, the 
adjustment means may determine an association be- 
tween a projection target area based on the sensing in- 
formation and a pixel area of a spatial light modulator 
that is part of the image projection means, and may ad- 
15 just the input image information in such a manner that 
a size of the image is adjusted. 

[0022] The image projection method may further com- 
prise determining an association between a projection 
target area based on the sensing information and a pixel 

20 area of a spatial light modulator that is part of the image 
projection means, and adjusting a size of the image. 
[0023] Since this makes it possible for the projection- 
type image display system or the like to automatically 
determine the association between the projection target 

25 area and the pixel area of the spatial light modulator, it 
enables the projection of an image of an appropriate im- 
age size. 

[0024] In the projection-type image display system, 
the projector, and the information storage medium, the 
30 image projection means may have projection direction 
adjustment means for adjusting a projection direction, 
and 

the adjustment means may output projection di- 
rection control information to the image projection 
35 means in such a manner that an image is projected on 
the projection area, the projection direction control in- 
formation controlling the projection direction adjustment 
means. 

[0025] The image projection method may further com- 
40 prise controlling the image projection means to control 
a projection direction in such a manner that an image is 
projected onto the projection area. 
[0026] Since this makes it possible for the projection- 
type image display system or the like to adjust the pro- 
45 jection direction automatically, the user can change the 
projection position in a simpler manner, without having 
to adjust the projection direction. 

[0027] In the projection-type image display system, 
the projector, and the information storage medium, the 

so sensing means may repeat the sensing and outputs the 
detection information at a predetermined timing, and 

the projectable area determination means may 
determine the projectable area anew, based on the new- 
est detection information. 

55 [0028] The image projection method may further com- 
prise: 

repeating the sensing and outputting the detection 
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information at a predetermined timing; and 
determining the projectable area anew, based on 
the newest detection information. 

[0029] Since this makes it possible for the projection- 
type image display system or the like to automatically 
adjust the projection of the image into an obstruction- 
free projection area if the position of an obstruction 
changes (specifically if the audience should intrude into 
the projection area) by sensing and performing edge de- 
tection repeatedly at a predetermined timing, the user 
can change the projection position in a simpler manner. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF 
THE DRAWING 

[0030] 

Fig. 1 is a schematic illustrative view of projection 
areas in accordance with an example of this em- 
bodiment; 

Fig. 2 is a functional block diagram of a projection- 
type image display system within a liquid-crystal 
projector in accordance with an example of this em- 
bodiment; 

Fig. 3 is a flowchart of the sequence of image pro- 
jection in accordance with an example of this em- 
bodiment; 

Fig. 4 is a block diagram of the hardware of the pro- 
jection-type image display system within the liquid- 
crystal projector in accordance with an example of 
this embodiment; and 

Fig. 5 is a functional block diagram of a projection- 
type image display system within a liquid-crystal 
projector in accordance with an example of this em- 
bodiment. 

DETAILED DESCRIPTION OF THE EMBODIMENT 

[0031] The present invention is described below, tak- 
ing as an example the application thereof to a projection- 
type image display system that uses a liquid-crystal pro- 
jector, with reference to the accompanying figures. Note 
that the embodiment described below does not in any 
way limit the scope of the invention as laid out in the 
claims herein. In addition, the entirety of the configura- 
tion described with reference to this embodiment is not 
limited to being essential structural components of the 
present invention. 

Description of Overall System 

[0032] The description below concerns an example in 
which a liquid-crystal projector is disposed in a domestic 
living room to project an image onto a wall. 
[0033] A schematic illustrative view of projection are- 
as in accordance with an example of this embodiment 
is shown in Fig. 1. 



[0034] When a wall surface is used as a projection tar- 
get area 1 0 for the projection of an image, the presence 
of obstructions such as a picture 20 or a decorative plant 
22 causes shadows in those portions, making it impos- 
5 sible to project the image suitably. 

[0035] Since a living room in particular is a location 
that is used by a plurality of members of the family, the 
positions of the picture 20 and the decorative plant 22 
often change, making it difficult to fix a projection area. 
10 [0036] Furthermore, if the living room and the kitchen 
are integrated into a single room, it would be convenient 
to project a TV image on the wall of the living room most 
of the time, but project the image of a recipe on the wall 
of the kitchen while cooking. 
is [0037] This embodiment of the invention performs 
edge detection by using a CCD sensorto sense the pro- 
jection target area 10, determines a plurality of projec- 
tion areas 40- 1 to 40-3 that satisfy a predetermined as- 
pect ratio, determines one projection area based on us- 
2° er selection, and uses that projection area to project the 
image. 

[0038] The employment of this method makes it easy 
to change the projection position, without requiring the 
user to move the liquid-crystal projector or change the 
25 projection position or projection direction manually. 

Description of Functional Blocks 

[0039] The description now turns to the functional 
30 blocks of a projection-type image display system that is 
installed in a liquid-crystal projector, in order to imple- 
ment this function. 

[0040] A functional block diagram of a projection -type 
image display system within a liquid-crystal projector in 
35 accordance with an example of this embodiment is 
shown in Fig. 2. 

[0041] The projection-type image display system 
comprises a sensor 60, an input signal processing sec- 
tion 11 0, a correction section 120, a D/A converter sec- 

*o tion 1 80, an image projection section 1 90, a projection- 
area/pixel-area associating section 1 30, a projection ar- 
ea determination section 140, a calibration signal gen- 
eration section 150, a lens adjustment section 160 : and 
an aspect ratio determination section 132. 

45 [0042] The input signal processing section 110 con- 
verts an R1 signal, a G1 signal, and a B1 signal (which 
form RGB signals in analog form that is a type of input 
image information that is input from a personal computer 
(PC) or the like) into an R2 signal, a G2 signal, and a 

50 B2 signal in digital form. 

[0043] The input signal processing section 110 com- 
prises an A/D converter section 112 that performs this 
analog-to-digital conversion and an image position/size 
adjustment section 1 1 4 that is part of adjustment means 

55 for adjusting the position and size of an image. 

[0044] Note that the A/D converter section 112 and 
the D/A converter section 1 80 are not necessary if only 
RGB signals in digital format are used in the projection- 
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type image display system. 
[0045] The calibration signal generation section 150 
generates an R2 signal a G2 signal, and a B2 signal in 
digital format that are used for displaying a calibration 
image. 

[0046] By generating the calibration signals within the 
liquid-crystal projector in this manner, it is possible for 
the liquid-crystal projector itself to perform the calibra- 
tion, without having to input calibration signals to the liq- 
uid-crystal projector from an external input device such 
as a PC. Note that the configuration could also be such 
that the calibration signal generation section 150 is not 
provided and the calibration image signals are input 
from a PC or the like. 

[0047] The correction section 120 outputs an R3 sig- 
nal, a G3 signal, and a B3 signal having a color temper- 
ature that has been corrected on the basis of a standard 
setting for the liquid-crystal projector, based on the R2 
signal, G2 signal, and B2 signal from the input signal 
processing section 110 or the lens adjustment section 
160. 

[0048] The D/A converter section 1 80 converts the R3 
signal, G3 signal, and B3 signal from the correction sec- 
tion 120 into an R4 signal, a G4 signal, and a B4 signal 
in analog format. 

[0049] The image projection section 1 90 comprises a 
drive section 191, a spatial light modulator 192, a pro- 
jection size adjustment section 193 : a projection direc- 
tion adjustment section 194, and a lens 195. 
[0050] The drive section 191 drives the spatial light 
modulator 192, based on the R4 signal, G4 signal, and 
B4 signal from the D/A converter section 1 80. The image 
projection section 190 projects light from a light source 
through the spatial light modulator 192 and the lens 195. 
[0051] With this embodiment, the projection area de- 
termination section 140 comprising a projection area se- 
lection section 142, a projectable area determination 
section 144, an edge detection section 146, and a pro- 
jection region detection section 148 is further provided 
in the liquid-crystal projector. 

[0052] The projection region detection section 148 
detects the region of the projection target area 10 (here- 
inafter called a projection region 1 0A), based on sensing 
information expressed as XYZ values from the sensor 
60, which is a sensing means that senses the projection 
target area 1 0. Note that is this case, XYZ values are a 
type of device-independent colors under an internation- 
al standard determined by the Commission Internation- 
ale de TEclairage (CIE). 

[0053] Note that the projection target area 1 0 and the 
projection region 1 0A are shown to be the same size in 
Fig. 1 , to facilitate the description. In this case, the pro- 
jection region 1 0A is a region on the projection target 
area 10 that is illuminated by the projection light. 
[0054] The edge detection section 1 46 performs edge 
detection, based on the XYZ values of the projection re- 
gion 10A on the projection target area 10. and outputs 
detection information. 
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[0055] The projectable area determination section 
144 identifies projection areas 40-1 to 40-3 within the 
projection region 10A of the projection target area 10 
which have no obstructions such as the picture 20 and 
5 which are of at least a fixed size that satisfies the aspect 
ratio, based on the detection information and a prede- 
termined aspect ratio (such as 16:9 or 4:3) from the as- 
pect ratio determination section 132. In Fig. 1 , a repre- 
sentative three projection areas 40-1 to 40-3 are shown, 
to simplify the description, but in practice a larger 
number of the projection areas could be obtained. If only 
one projection area can be obtained, that is selected. 
The projectable area determination section 144 detects 
that a portion bounded by the outermost boundary lines 
of the projection areas is a projectable area 30. 
[0056] Note that a plurality of the projectable areas 30 
could be detected if the projection areas do not overlap. 
[0057] The projection area selection section 142 se- 
lects one projection area, based on a selection indica- 
tion from the user (such as an indication by a remote 
controller of the liquid-crystal projector), for selecting 
one projection area from the plurality of projection areas 
40-1 to 40-3 comprised within the projectable area 30. 
[0058] The lens adjustment section 1 60 that is part of 
the adjustment means outputs projection size control in- 
formation to the projection size adjustment section 1 93, 
to adjust the zoom ratio of the lens 1 95 in such a manner 
that an image is projected onto the projection area that 
has been selected by the projection area selection sec- 
tion 142. 

[0059] The projection size adjustment section 1 93 ad- 
justs the projection size by adjusting the zoom ratio of 
the lens 1 95, based on that projection size control infor- 
mation. 

[0060] The projection-area/pixel-area associating 
section 130 that is part of the adjustment means deter- 
mines the association between the projection area with- 
in the projection region 1 0A on the projection target area 
10 and the pixel area of the spatial light modulator 1 92, 
based on the projection region 1 0A on the projection tar- 
get area 10 that was detected by the projection region 
detection section 148 and the projection area selected 
by the projection area selection section 142. Specifical- 
ly, the projection-area/pixei-area associating section 
130 obtains the ratio between the projection region 10A 
on the projection target area 1 0 and the pixel area of the 
spatial light modulator 192. 

[0061 ] Instead of this method, the project ion -area/pix- 
el-area associating section 130 could obtain the asso- 
ciation between coordinates on the projection region 
10A (coordinates on the light-receiving element of the 
sensor 60) and coordinates on a projected image (cali- 
bration image). This is because coordinates on the pro- 
jected image could be converted into coordinates on the 
image area of the spatial light modulator 192. 
[0062] Note that the relationship between a pixel that 
is in the projected image and a pixel portion of the spatial 
light modulator 192 that displays that pixel is known to 
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the image projection section 190. 
[0063] The image position/size adjustment section 
114 adjusts the input image information in such a man- 
ner that the position and size of the image are adjusted, 
based on the ratio obtained by the projection-area/pixel- 
area associating section 130 and position information 
for the projection region 10A on the projection target ar- 
ea 10 of the projection area selected by the projection 
area selection section 142. 

Description of Image Processing Flow 

[0064] The description now turns to the flow of image 
processing using these components, with reference to 
a flowchart. 

[0065] A flowchart of the sequence of image projec- 
tion in accordance with an example of this embodiment 
is shown in Fig. 3. 

[0066] First of all, the sensor 60 senses the projection 
target area 10 in a state in which there is no image dis- 
played, in other words, in a state in which nothing is dis- 
played or a completely black image is displayed, and 
measures the XYZ values of each pixel of that image 
(step S1). 

[0067] The lens adjustment section 160 outputs pro- 
jection size control information for adjusting the zoom 
ratio of the lens 195 so as to maximize the image size, 
to the projection size adjustment section 193. The cali- 
bration signal generation section 150 generates calibra- 
tion signals (R2, G2, B2) in such a manner that a full- 
screen white image is displayed. 

[0068] The thus-configured liquid-crystal projector 
displays the white image at the maximum image size 
and the sensor 60 measures the XYZ values of each 
pixel of the white image displayed on the projection tar- 
get area 1 0 (in other words, each pixel within the sensor 
60 that outputs measured values of that white image) 
(step S2). 

[0069] In a similar manner, the lens adjustment sec- 
tion 160 outputs projection size control information for 
adjusting the zoom ratio of the lens 195 so as to mini- 
mize the image size, to the projection size adjustment 
section 193. The calibration signal generation section 
150 again generates calibration signals (R2, G2, B2) in 
such a manner that a full-screen white image is dis- 
played. 

[0070] The thus-configured liquid-crystal projector 
displays the white image at the minimum image size and 
the sensor 60 measures the XYZ values of each pixel 
of the white image displayed on the projection target ar- 
ea 10 (step S3). 

[0071] The projection region detection section 148 
detects the maximum and minimum projection region 
10A, based on the difference between the XYZ values 
measured when nothing was displayed and the XYZ val- 
ues measured at the maximum size, and the difference 
between the XYZ values measured when nothing was 
displayed and the XYZ values measured at the mini- 



mum size (step S4). In this case, a pixel having a differ- 
ence of at least 5cd/m 2 could be considered to be a pixel 
comprised within the projection region 10A of the pro- 
jection target area 10, by way of example. Note that in- 
5 stead of sensing information (XYZ values) obtained 
when the black calibration image is displayed, it is also 
possible to use sensing information forthe projection re- 
gion 10A on the projection target area 10 when nothing 
is displayed. 

io [0072] The edge detection section 1 46 executes edge 
detection processing based on the XYZ values meas- 
ured when nothing was displayed (step S5). 
[0073] The projectable area determination section 
1 44 determines the projectable area 30 (that is, an area 

'5 comprising at least one of the projection areas), based 
on the image aspect ratio from the aspect ratio determi- 
nation section 132 and the edge detection data from the 
edge detection section 146 (step S6). More specifically, 
the projectable area determination section 144 detects 

20 edge detection data from the top left of that region to the 
bottom right thereof, and specifies the maximum area 
that satisfies a desired aspect ration (that is, one of the 
projection areas). If there is a many-sided area such as 
the projectable area 30 shown in Fig. 1 , by way of ex- 

25 ample, a plurality of projection areas 40-1 to 40-3 is se- 
lected. 

[0074] The projection area determination section 140 
outputs information indicating the plurality of projection 
areas 40-1 to 40-3 selected by the projectable area de- 

30 termination section 144 to the input signal processing 
section 110, and the image projection section 190 
projects to the user a selection image enabling the se- 
lection of one projection area from that plurality of pro- 
jection areas 40-1 to 40-3. In this case, the input signal 

35 processing section 1 1 0 could have stored therein image 
information for generating the selection image. 
[0075] The projection area selection section 142 se- 
lects one projection area from the plurality of projection 
areas 40-1 to 40-3, based on a predetermined criterion 

^o (such as the uppermost, lowermost, leftmost, or right- 
most) or the user's indication, and determines a lens 
zoom ratio that ensures that the projection region 10A 
comprises the selected projection area and also the pro- 
jection region 10A is of the minimum projection size 

45 (step S7). 

[0076] Note that this use of the minimum projection 
size ensures that it is possible to increase the brightness 
in comparison with the maximum projection size. Of 
course the projection size need not be the minimum. 

50 [0077] The lens adjustment section 160 generates 
projection size control information that ensures that 
zoom ratio, and the projection size adjustment section 
193 adjusts the zoom ratio of the lens 195, based on 
that projection size control information (step S8). 

55 [0078] The projection -area/pixel -area associating 
section 130 determines the association between the 
projection area at that zoom ratio and the pixel area of 
the spatial light modulator 192 (step S9). In this case, 
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the image could be resized so that the entire region of 
the image represented by the image signal is projected 
into the selected projection area, or the image could be 
trimmed for projection into the selected projection area. 
[0079] The image position/size adjustment section 
114 adjusts the digitally converted input image signal in 
such a manner as to adjust the position and size of the 
image, based on this association, and outputs digital 
signals (R2, G2, B2). 

[0080] The correction section 120 also performs ad- 
justments such as color temperature adjustments on 
these digital signals (R2, G2 ; B2), and the D/A converter 
section 180 outputs analog signals (R4 : G4, B4) that 
have been converted from the digital signals. 
[0081] The drive section 191 drives the spatial light 
modulator 192 on the basis of the analog signals (R4, 
G4, B4), and the projection size adjustment section 1 93 
adjusts the zoom ratio of the lens 195. 
[0082] In this manner, the image projection section 
190 adjusts the position and size of the image and 
projects the image onto the projection area (step S10). 
[0083] As described above, this embodiment makes 
it possible for a projection-type image display system to 
automatically select the projectable area 30 in which 
there are no obstructions (such as desks or members 
of the audience) ; so that the user can change the pro- 
jection area easily. 

[0084] If the living room and kitchen are integrated in- 
to the same room, for example, the user would usually 
project images on a wall surface of the living room, but 
might also want to project an image onto a wall surface 
in the kitchen when cooking. 

[0085] In such a case, this embodiment makes it easy 
fro the user to switch between projection into the living 
room and projection into the kitchen. 
[0086] During a presentation, a right-handed present- 
er would find it easier to use an indicator rod with an 
image that is displayed on the right side, as seen from 
the audience, whereas a left-handed presenter would 
find it easier to use an indicator rod with an image dis- 
played on the left side. 

[0087] In such a case, this embodiment makes it pos- 
sible to project an image at a position preferred by the 
user, without the user having to adjust the projection po- 
sition manually. 

[0088] Since this embodiment also makes it possible 
for the projection-type image display system to adjust 
the projection size automatically, it enables a simpler 
changing of the projection position, without requiring the 
user to adjust the projection size. 

[0089] Furthermore, since this embodiment makes it 
possible for the projection-type image display system to 
automatically determine the association between the 
projection region 10A on the projection target area 10 
and the pixel area of the spatial light modulator 192, it 
enables the projection of an image at the appropriate 
image size at the appropriate location. 
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Description of Hardware 

[0090] Note that the hardware described below by 
way of example can be used to implement the above 
5 described components. 

[0091] A block diagram of the hardware of a projec- 
tion-type image display system within a liquid-crystal 
projector in accordance with an example of this embod- 
iment is shown in Fig. 4. 
10 [0092] For example, the configuration could be imple- 
mented by an A/D converter 930 or the like as the A/D 
converter section 112; a D/A converter 940 or the like 
as the D/A converter section 1 80; a ROM 960 or the like 
in which is stored a liquid-crystal light bulb driver as the 
is drive section 191; a liquid crystal panel 920 and liquid 
crystal light valves as the spatial light modulator 1 92; an 
image processing circuit 970 and a CPU 910 or the like 
as the projector color converter section 120, the projec- 
tion area selection section 142, the projectable area de- 
termination section 1 44, the edge detection section 1 46, 
the projection region detection section 148, the projec- 
tion-area/pixel-area associating section 1 30, the aspect 
ratio determination section 1 32, and the lens adjustment 
section 1 60; RAM 950 orthe like as thecalib ration signal 
generation section 150; a generic lens zooming mech- 
anism orthe like as the projection size adjustment sec- 
tion 193; a generic direction control mechanism as the 
projection direction adjustment section 194, and a sen- 
sorthat is capable of extracting XYZ values from a multi- 
pixel sensor such as a CCD sensor or CMOS sensor as 
the sensor 60. Note that these components can ex- 
change information between themselves over a system 
bus 980. Note also that these portions could be imple- 
mented in a hardware fashion by circuitry, or they could 
be implemented in a software fashion by drivers. 
[0093] In addition, these functions could be imple- 
mented by a computer within the liquid-crystal projector 
reading out a program from an information storage me- 
dium 300. 

[0094] The information storage medium 300 could be 
a CD-ROM, DVD-ROM, ROM, RAM, or HDD, by way of 
example, and the method of reading the program there- 
from could be a direct method or an indirect method. 
[0095] Instead of the information storage medium 
300, it is also possible to download a program that im- 
plements the above-described functions, from a host 
device over a network, in order to implement the above- 
described functions. 



[0096] For example, the projectable area 30 may be 
determined based on information other than the edge 
detection information although the aforementioned em- 
55 bodiment has been described as to the projectable area 
determination section 144 determining the projectable 
area 30 based on the edge detection information in the 
sensed image from the edge detection section 146. For 
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example, the projectable area determination section 

144 may determine the projectable area 30 based on 
the color distribution in the sensed image. 

[0097] In other words, the projectable area 30 can be 
selected by detecting the distribution of XY2 values rep- 
resenting colors, for example ; since, in Fig. 1, the XYZ 
values relating to the obstruction such as the decorative 
plant 22 or the like in the sensed image are different from 
the XYZ values in the projectable area 30. The tech- 
nique of selecting the projectable area 30 based on the 
color distribution will be described below. 
[0098] Fig. 5 is a functional block diagram of a projec- 
tion-type image display system in a liquid-crystal projec- 
tor according to an example of this embodiment. 
[0099] In this embodiment, the edge detection section 

146 is replaced by a color-distribution detection section 

147 which is designed to output detection information 
indicating the color distribution in the sensed image 
(which may be the whole or part of the sensed image) 
from the sensor 60 while the projectable area determi- 
nation section 144 is replaced by a projectable area de- 
termination section 145. 

[0100] After the process in the projection region de- 
tection section 148 {step S4) described in connection 
with Fig. 3, the color-distribution detection section 147 
detects the color distribution in the projection region 10A 
based on the sensing information (XYZ values) relating 
to a portion corresponding to a projection region having 
the maximum image size in the sensed image when 
nothing is displayed. 

[0101] More particularly, the color-distribution detec- 
tion section 147 generates the histogram (or frequency 
distribution) of XYZ values for a predetermined image 
processing unit (a pixel block constructed by a fixed 
number of pixels along the horizontal and vertical direc- 
tions; one pixel or the like). 

[0102] And, the color-distribution detection section 
147 detects a range of X-value having upper frequency 
(XP1 to XP2) in the histogram of X value. Similarly, the 
color-distribution detection section 147 detects a range 
of Y-value having upper frequency (YP1 to YP2) and a 
range of Z-value having upper frequency (ZP1 to ZP2). 
These ranges are optional. For example, they may be 
identical with one another or different from one another. 
[0103] The co I or- distribution detection section 147 
then outputs these pieces of color-distribution informa- 
tion (XP1 to XP2, YP1 to YP2 and ZP1 to ZP2) toward 
the projectable area determination section 145. 
[0104] The projectable area determination section 

145 determines the projectable area 30, based on an 
aspect ratio of image from the aspect ratio determination 
section 132 and the information of detected color distri- 
bution from the color-distribution detection section 147. 
[0105] More particularly, the projectable area deter- 
mination section 145 selects an area AX having an X- 
value in the range of X-value (XP1 to XP2) from the 
color-distribution detection section 147 based on the 
sensing information relating to a portion corresponding 



to the projection area 10A in the sensed image. In ad- 
dition, the sensing information has an ordinate position, 
an abscissa position, X-value, Y-value and Z-value for 
each coordinate position. Therefore, the projectable ar- 

5 ea determination section 145 can select the area AX 
since it can detect the ordinate and abscissa positions 
in the coordinates having the X-value which can be used 
as a searching key. Similarly, areas AY and AZ for Y and 
Z values may be selected. 

w [0106] According to such a procedure, the projectable 
area determination section 145 selects the area AX hav- 
ing the X-value in the range of X-value (XP1 to XP2), 
the area AY having the Y-value in the range of X-value 
(YP1 to YP2) and the area AZ having the Z-value in the 

15 range of Z-value (ZP1 to ZP2) in addition to an area AA 
(the projectable area 30 in Fig. 1 , for example) in which 
the areas AX, AY and AZ overlap each other. 
[0107] In such a manner the projectable area 30 can 
be selected. The remaining procedure portion may be 

20 accomplished by various steps after the above-men- 
tioned step S6 in FIG. 3. 

[0108] By adopting such a technique based on the 
color distribution, the liquid-crystal projector according 
to this embodiment can select the projection area as a 

25 portion satisfying the aspect ratio among an area which 
has the same color and is not been influenced by the 
environment (due to the fluorescent lamp or the like) or 
is influenced by the environment, even if part of the pro- 
jection target area 10 has been influenced by that envi- 

30 ronment. 

[0109] The liquid -crystal projector according to this 
embodiment can perform the processing at a higher 
speed and in a more efficient manner since the edge 
detection can be omitted by adopting the technique 

35 based on the color distribution. 

[0110] However, the technique of detecting the color 
distribution is not limited to the aforementioned tech- 
nique. For example, the range of XYZ values may be 
determined by calculating with different coefficient val- 

40 ues or by using a certain function. Moreover, the indexes 
for detecting the color distribution may be in the form of 
RGB values, rather than the XYZ values. 
[0111] If part of the projection target area 10 is an 
empty space when the liquid-crystal projector is used 

45 outdoors or if part of the projection target area 1 0 is on 
a glass window which will not reflect the projected light 
from the liquid-crystal projector when it is used in a class 
room, the liquid-crystal projector may perform the fol- 
lowing process. 

50 [01 12] For example, if the liquid-crystal projector is to 
project a rectangular image, it can determine the afore- 
mentioned projection area by repeatedly projecting and 
imaging points or lines indicative of four corners in the 
image while narrowing the projection range and detect- 

55 ing these points or lines through the sensor 60 before 
the four corners in the sensed image are associated with 
the coordinates of the four corners in the spatial light 
modulator 192. 
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[0113] Moreover, the edge detection may be carried 
out by use of sensing information indicative of differenc- 
es between the XYZ values of the sensed image relating 
to the monochromatic white-colored calibration image 
and the XYZ values of the sensed image relating to the 
monochromatic black-colored calibration image al- 
though this embodiment has been described as to the 
single black-colored calibration image used to perform 
the edge detection or the like by the liquid-crystal pro- 
jector. 

[0114] In such a manner, even if the projection target 
area 1 0 includes areas of differently influenced environ- 
ment the liquid-crystal projector can perform the color- 
distribution detection and the like while correcting such 
difference. 

[0115] Further for example, the configuration could 
be such that the lens adjustment section 160 outputs 
projection direction control information for controlling 
the projection direction to the projection direction adjust- 
ment section 194, instead of the projection size. 
[0116] This would make it possible to adjust the pro- 
jection direction automatically, thus making it easy for 
the userto change the projection position without having 
to adjust the projection direction. 

[0117] The projection size could also be fixed so that 
only the projection direction is changed. This would en- 
able simple changing of the projection position. 
[0118] In addition, the selection of the projection area 
by the user could be done by a button on the projector 
itself of by a remote-control action, and the user could 
use a physical indication or a verbal indication. 
[01 19] In the above-described embodiment, the max- 
imum projectable area 30 was obtained initially by se- 
lecting at least one projection area that satisfies the as- 
pect ratio, but at least one projection area that satisfies 
the aspect ratio could be selected within the projectable 
area 30 after the obstruction-free projectable area 30 
has been obtained. 

[01 20] It is also possible to perform parallax distortion 
correction or automatic focus adjustment during the pro- 
jection. 

[0121] The projection area in the above-described 
embodiment was a rectangle, but a shape other than a 
rectangle can equally well be used as the projection ar- 
ea, such as a circle. 

[0122] Furthermore, the image projection processing 
of Fig. 3 could be repeated at a predetermined timing 
(such as every predetermined time, or whenever the 
presenter changes). 

[0123] Since this makes it possible to automatically 
adjust the image so that it is projected into an obstruc- 
tion-free projection area, by performing the sensing and 
edge detection repeatedly at a predetermined timing if 
there is a change in the position of an obstruction or if 
more of the audience encroach into the projection area, 
the user can change the projection position in a simpler 
manner. In addition, the projection area could be deter- 
mined from the positions of obstructions. 



[0124] The projection-type image display system of 
this embodiment was described above as being applied 
to a liquid-crystal projector but it can also be applied to 
various other types of projection-type display systems 

5 such as a projector using a digital micromirror device 
(DMD) as the spatial light modulator. Note that DMD is 
a trademark registered to Texas Instruments Inc. of the 
USA. In addition, the projector is not limited to a front- 
projection type; it could equally well be a rear-projection 

10 type of projector. 

[0125] Other than a domestic environment such as 
the above-described living room, the present invention 
is also effective for projecting images in commercial ap- 
plications such as meeting rooms, medical facilities, ad- 

15 vertisement locations, educational locations, cinemas, 
and exhibition halls. 

[0126] Note that the above-described functions of the 
projection-type image display system could be imple- 
mented by the liquid-crystal projector itself, by way of 
20 example, or they could be implemented by processing 
distributed between a plurality of processing devices 
(such as the liquid-crystal projector and a PC). 



1 . A projection-type image display system comprising: 

sensing means for sensing a projection target 
area and outputting sensing information; 
detection means for performing edge detection 
or color-distribution detection based on the 
sensing information and outputting detection 
information which indicates edge in a sensed 
image or color distribution in a sensed image; 
projectable area determination means for de- 
termining a projectable area which has no ob- 
structions within the projection target area, 
based on the detection information; 
projection area selection means for selecting a 
projection area within the projectable area, 
based on a user selection or a predetermined 
reference; 

adjustment means for adjusting at least one of 
input image information and image projection 
means, in such a manner that an image is dis- 
played on the projection area; and 
image projection means for projecting an image 
towards the projection area, based on the input 
image information. 

2. The project ion -type image display system as de- 
fined by claim 1 , 

wherein the image projection means has pro- 
jection size adjustment means which adjusts a pro- 
jection size, and 

wherein the adjustment means outputs pro- 
jection size control information to the image projec- 
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tion means so that an image is projected onto the 
projection area, the projection size control informa- 
tion being used for controlling the projection size ad- 
justment means. 

5 

3. The projection-type image display system as de- 
fined by claim 2, 

wherein the projection size adjustment means 
adjusts a lens zoom ratio for projecting an image in 
such a manner that a projection range for the pro- 10 
jected image becomes a minimum size including 
the projection area selected by the projection area 
selection means. 



4. The project ion -type image display system as de- 
fined in any one of claims 1 to 3, 

wherein the adjustment means determines an 
association between a projection target area based 
on the sensing information and a pixel area of a spa- 
tial light modulator that is part of the image projec- 
tion means, and adjusts the input image information 
in such a manner that a size of the image is adjust- 
ed. 

5. The projection-type image display system as de- 
fined by claim 1 , 

wherein the image projection means has pro- 
jection direction adjustment means for adjusting a 
projection direction, and 

wherein the adjustment means outputs pro- 
jection direction control information to the image 
projection means in such a manner that an image 
is projected on the projection area, the projection 
direction control information controlling the projec- 
tion direction adjustment means. 

6. The project ion -type image display system as de- 
fined by claim 1 , 

wherein the sensing means repeats the sens- 
ing and outputs the detection information at a pre- 
determined timing, and 

wherein the projectable area determination 
means determines the projectable area anew, 
based on the newest detection information. 

7. A projector comprising: 

a sensing means which senses a projection tar- 
get area and outputs sensing information; 
a detection means which performs edge detec- 
tion or color-distribution detection based on the 
sensing information and outputs detection in- 
formation which indicates edge in a sensed im- 
age or color distribution in a sensed image; 
a projectable area determination means which 
determines a projectable area which has no ob- 
structions within the projection target area, 
based on the detection information; 



a projection area selection means which se- 
lects a projection area within the projectable ar- 
ea, based on a user selection or a predeter- 
mined reference; 

an adjustment mean which adjusts at least one 
of input image information and image projection 
means, in such a manner that an image is dis- 
played on the projection area; and 
an image projection means which projects an 
image towards the projection area : based on 
the input image information. 

8. An information storage medium which storage a 
computer-readable program causing a computer to 
15 function as: 



sensing means for sensing a projection target 
area and outputting sensing information: 
detection means for performing edge detection 

20 or color-distribution detection based on the 

sensing information and outputting detection 
information which indicates edge in a sensed 
image or color distribution in a sensed image; 
projectable area determination means for de- 

25 termining a projectable area which has no ob- 

structions within the projection target area, 
based on the detection information; 
projection area selection means for selecting a 
projection area within the projectable area, 

30 based on a user selection or a predetermined 

reference; 

adjustment means for adjusting at least one of 
input image information and image projection 
means, in such a manner that an image is dis- 
ss played on the projection area; and 

image projection means for projecting an image 
towards the projection area, based on the input 
image information. 

40 9. The information storage medium as defined by 
claim 8, 

wherein the image projection means has pro- 
jection size adjustment means which adjusts a pro- 
jection size, and 

45 wherein the adjustment means outputs pro- 

jection size control information to the image projec- 
tion means so that an image is projected onto the 
projection area, the projection size control informa- 
tion being used for controlling the projection size ad- 

50 justment means. 

10. The information storage medium as defined by 
claim 9, 

wherein the projection size adjustment means 
55 adjusts a lens zoom ratio for projecting an image in 

such a manner that a projection range for the pro- 
jected image becomes a minimum size including 
the projection area selected by the projection area 
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selection means. 

11. The information storage medium as defined in any 
one of claims 8 to 10, 

wherein the adjustment means determines an 
association between a projection target area based 
on the sensing information and a pixel area of a spa- 
tial light modulator that is part of the image projec- 
tion means, and adjusts the input image information 
in such a manner that a size of the image is adjust- 
ed. 

12. The information storage medium as defined by 
claim 8, 

wherein the image projection means has pro- *5 
jection direction adjustment means for adjusting a 
projection direction, and 

wherein the adjustment means outputs pro- 
jection direction control information to the image 
projection means in such a manner that an image 20 
is projected on the projection area, the projection 18. 
direction control information controlling the projec- 
tion direction adjustment means. 

13. The information storage medium as defined by 25 
claim 9, 

wherein the sensing means repeats the sens- 
ing and outputs the detection information at a pre- 
determined timing, and 

wherein the projectable area determination 30 
means determines the projectable area anew, 
based on newest detection information. 



controlling the image projection means to ad- 
just a projection size so that an image is pro- 
jected on the projection area. 

5 16. The image projection method as defined in any one 
of claims 14 and 15, further comprising: 

determining an association between a projec- 
tion target area based on the sensing informa- 
10 tion and a pixel area of a spatial light modulator 

that is part of the image projection means : and 
adjusting a size of the image. 

17. The image projection method as defined by claim 
14, further comprising: 

controlling the image projection means to con- 
trol a projection direction in such a manner that 
an image is projected onto the projection area. 

The image projection method as defined by claim 
14, further comprising: 

repeating the sensing and outputting the detec- 
tion information at a predetermined timing; and 
determining the projectable area anew, based 
on the newest detection information. 



14. An image projection method comprising: 

35 

sensing a projection target area and outputting 
sensing information; 

performing edge detection or color-distribution 
detection based on the sensing information and 
outputting detection information which indi- *o 
cates edge in a sensed image or color distribu- 
tion in a sensed image; 

determining a projectable area which has no 
obstructions within the projection target area, 
based on the detection information; 45 
selecting a projection area within the projecta- 
ble area, based on a user selection or a prede- 
termined reference; 

adjusting at least one of input image informa- 
tion and image projection means, in such a so 
manner that an image is displayed on the pro- 
jection area; and 

projecting an image towards the projection ar- 
ea, based on the input image information. 

55 

15. The image projection method as defined by claim 
14, further comprising: 
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(54) Projector-type image display system, projector, information storage medium and image 
projection method 



(57) To provide a projection-type image display sys- 
tem, a projector, an information storage medium, and 
an image projection method that enable simple chang- 
ing of a projection position, a liquid-crystal projector is 
provided with: a sensor 60 which senses a projection 
target area and outputs sensing information; an edge 
detection section 146 which outputs detection informa- 
tion, based on the sensing information; a projectable ar- 
ea determination section 144 which determines a pro- 
jectable area which has no obstructions within the pro- 



jection target area, based on the detection information; 
a projection area selection section 142 which selects a 
projection area within the projectable area, based on a 
user selection or a predetermined reference; a projec- 
tion-area/pixel-area associating section 130 and a lens 
adjustment section 160 which performs predetermined 
adjustments in such a manner that an image is dis- 
played on the projection area; and an image projection 
section 190 which projects an image towards the pro- 
jection area, based on the input image information. 
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